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THE lUVt^: OF LATE RESPONDENTS TO ESTT^4ATE THE NATURE OF NON-RKGPONDEHTS 
^. ^ 

^ o 

^1 by Herbert Goldhor 
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When people are asked to supply information (whether by mail or in person), 

many refuse or fail to do so. It is often critical to knov whether or not the 

non-respondents differ and by how much from tne respondents, on various relevant 

traits. It has been suggested that one way by which to do this is by comparing 

early and late respondents , on the assumption that late respondents are more 

nearly like the non-respondents than like the early respondents i"^^ This 

(2) ^3) 

assumption has been challenged and tested with generally negative results. 

Presumably those with a special interest in the subject at issue will 

answer earlier and significantly more often than will those with less or no 

interest. As Suchman points out, the question is not whether tb." surve, returns 

are biased but whether the bias affects the test of the hypothesis, ana of^- n 

it does not. Lacking information on that question, one's confidence is strength 

ened or reduced by a knowledge of whether respondents are or are not characteristic 

different from non-respondents. 

In a recent study, data were available by which to compare early respondents 

with late respondents and with non-respondents on three traits, and in a setting 

(6) 

in which interest or lack of interest in the subject was not a factor. For 
twelve months in 1969-TO, certain data were collected on all adult borrowers of 
110 selected titles in both the Urbana and Champaign (ill,) Public Libraries, 
/rom the circulation records and borrower registration files of the two libraries, 
it was possible to ascertain in most cases (a) the type of book borrowed .i.e. , 
v/hether it was fiction or non-fiction) , (b) the sex of the borrower, and (c) his 
occupation. An effort was made to reach the II86 borrowers by either telephone 
or mail about three weeks after they had taken the books. Responses were securea 
from 718 borrowers {60% of the total), but 233 (20%) did not respond, and another 
23!^ {20%) were not approached either because they had borrowed ont^ of tne^je 
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selected titles more than once in three months (and it was feared that repeated 
polling would be inadvisable), or in a few cases, because the Information needed 
to locate them was incomplete or incorrect • 

Of all 718 respondents from whom usable information was secured, 79^ were 
reached by the first method of contact (either by one or more telephone calls, 
or by a postcard sent- first or when there was no answer by phone Infomation 
was secured from the other 21% of all respondents by one or more telephone calls f^- 
after a postcard had been sent and never returned* The former group constitutes 
the first wave of respondents in that they replied after the first effective 
contact was made with therr*; the second and smaller group is here called the 
second wave of respondents because they replied only after a second contact was 
made with them. This assumes that the postcards sent to the respondents in this 
second group were indeed delivered; we did not directly confirm this, but it is 
indirectly supported by the fact that our information on these respondents^ home 
telephone was correct and so presumably was our record of their home address. 

Each person who was reached by phone or postcard was asked to answer four 
questions on his use of one of the selected titles, viz,, (l) whether he had 
borrowed the book for himself (or for someone else, or loaned his card to some*- 
one else to use), (2) liow much of the book he had read, (3) how he had come to 
select this particular book, and (1+) whether or not the book had served his 
purpose in borrowing it. 

The information secured (for the three categories from circulation and 
registration records and for the four questions asked of those borrowers vho 
could be reached) was utilized to ascertain whether conditions in the use of the 
two libraries were comparable (l) in the first six-month period and again (2) 
in the second six-month period when an experimental variable was introduced in 
o.:'? of the libraries. The question to be discussed here, however, concernr* 
whether the differences between the first and second waves of respondents vould 




have predicted correctly the known distribution of the non-respondents. Table 1 
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shows results foi* all three traits for which we had information. The differences 

between the first and second waves of respondents, by type of book borrowed, 

point in a different direction for the non-respondents than is known to be 

true, and the size of the difference between predicted and observ3d is just 

beyond the limits of sanpling variability. In regard to sex, the non- respondents 

were in the predicted direction but much beyond what was predicted. And, on the 

< o 

third trait, occupation, no change was predicted but in fact there was^shift; how- 
ever, the differences between the predicted and- observed distributions of the 
non-respondents are random. 

The data so far presented, however, are really for a combination of four 
different samples, viz.» one for each of two time periods for each of two 
libraries. In the original study, these four samples were compared with each 
other to establish the equivalence or non-equivalence of the respective situations. 
Since the experimental period in the Champaign Public Library was the critical 
one, and since it accounts for kQ% of all the circulations in the original study 
and -36^ of all the responses, we will analyze that sample in the same manner as 
was done for all fo\ir samples combined. 

Table 2 shows that, on all three variables, the predicted distribution of 
non-respondents is in the reverse direction from their actual or known distribution. 
The differences between the observed and the predicted distribution of the non- 
respondents are greater than can be explained by sampling variability. Similarly 
of the three other sub-samples (with three comparisons each), 7 would have pre- 
dicted distributions in the wrong direction, one would have indicated no change 
when there was a marked change, and one predicted the correct direction but much 
more of a change than there was. When the four samples werrs combined, many of 
the dii'^ferences cancelled each other and produced the results shown in Table 1 
which give some support to the hypothesis that late respondents are more like 
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non-i^rsr>ondentn tluin like early respondents. 

It thus appears from these data that, when we have knowledge of the non- 
respondents, the direction of change between the first and second waves does not 
usually predict correctly even the direction of difference between the second 
wave and the non-respondents, and the differences between the predicted and 
observed distributions of the non-respondents are often significantly greater 
than what one might expect by chance alone. Even when interest in a subject is 
not a major factor, differences (or lack of differences) between early and late 
respondents cannot be relied on to predict correctly the nature of the non- 
respondents. In other words, according to the data of the present study, late 
respondents are not necessarily more like non-respondents than like early 
respondents • 
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Table 1. Comparisons Between First and Second Waves of Respondents and 
Non-Respondents 



A, By Type of Book Borrowed^ 



Fiction 
Non-Fiction 
Total 



First 
Wave 

153 {26%) 



Second 
Wave 

9h {16%) 
30 {2k%) 
12^(100^) 



Mon-Respondents 
(A.ctual) (Predicted) 



161 (12%) 
72 (28"^) 
233(100?^) 



182 (78%) 
^1 {22%) 
233(100%) 



(X = k.dS, 1 df, p = .03) 



B. By Sex 



Male 
Female 

Total 



By Occupation 



108 (18^) 
U77 (82^) 
585(100^) 



25 ( 

_28 ( 



) 



?3(100^) 



69 (30^) 
160 (TO^) 
229(100^) 



50 (22^) 

179 (78^) 
229(100^) 



(X^ = h.lQ, 1 df, p = .Oh) 



Student 
Non-Student 
Total 



207 ih2%) 
288 (58^) 

H95(ioo^) 



U5 {h2%) 
62 .{3m 
107(100^) 



96 (50^) 
98 (50^) 
19^(100^) 



82 {h2%) 
112 (58/.) 
19^(100^) 



(X^ = 2.00, 1 df , p = .16) 



Table 2. Compai'i son Between First and Second Waver- of Respondents and 
Non-HeL^pondents , in Champaign in the Experimental Period 



By Type of Book Borrowed 



Fiction 
Non-Fiction 
Total 



First 
Wave 

1T6 (62/0 
39 

215(lO0/») 



Second 
Wave 



h5 {90%) 
_5. {10%) 
50(100/0 



Non-Respondents 
(Actual) ( Predicted ) 



63 {15%) 
21 {23%) 
"8F(100/) 



82 (98^) 

2 {2io) 
"WdOO/) 



[y? = i8,i6, 1 df, p-^.ooi) 



B. By Sex 

Male 
Female 

Total 



3T (IT^) 
ITT (83/) 
2±h{iQQ%) 



5 (10^) 
iil (90/) 
50(100^0 



28 {3h%) 
5h. (66/) 
82(100/) 



2 {3%) 
_80. (97/) 
82(100/) 



(X^ = 2T.50, 1 df , p ^ .001) 



By Occupation 



Student 
Non-Student 
Total 



52 (30/) 
120 (TO/) 
172(100/) 



10 (21+/) 
31 (T6^) 

Ti(ioo/) 



30 (U3/) 
jiO (5T/) 
T0(100/) 



13 (18/) 
57 (82/0 
70(100/) 



(X = 9.68, 1 df, p <.0l) 
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